IN THE CLAIMS: 



Claim 1 is amended herein. 
Claims 11-31 are added. 
No claims are canceled. 

1 . (Currently Amended) A system for image-based information retrieval from search 
engines or databases , characterized by a) a terminal with a built-in camera that is connected 
to a remote data transmission network; b) a server computer on which an object recognition 
program is running, which analyses images sent to it and provides them with a symbolic 
indexing; c) a search engine that uses the indexed image to find information about the image 
and sends it back to the terminal. 

2. (Original) The system as described under 1) that is designed for mobile 
telephones or portable computers that have a built-in camera. 

3. (Original) A city or museum guide that uses the system described under 2) to 
provide a user with information about objects of which he or she has previously taken a 
picture. 

4. (Original) The system as described under 3) in which positioning information is 
also used to appropriately limit the image recognition system. 

5. (Original) The system as described under 2) that provides product information 
about products that have been previously photographed with the mobile camera. 
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6. (Original) The system as described under 2) in which the image recognition 
system is also able to recognize text characters or symbols. 

7. (Original) The system as described under 2) in which the system is, in particular, 
able to recognize faces. 

8. (Original) The system as described under 2) that is used to provide the user with 
additional information about advertising billboards. 

9. (Original) An electronic user handbook that uses a system as described under 2) 
to quickly navigate access to corresponding sections of the handbook. 

10. (Original) The system as described under 2) that allows providers of information 
to independently make new entries in the image processing system for the purpose of 
allowing their data to be retrieved by means of image entry. 



11. (New) A computer implemented system for image-based searching, comprising: 
a computer server, communicatively coupled with a network, that receives an 
input image from a user device communicatively coupled with the 
network; 

an image recognition system executed by the computer server and adapted to: 
determine a plurality of graphical attributes of the input image; 
match the input image to a reference image from a plurality of 

reference images stored in the storage medium, based on the 
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plurality of graphical attributes of the input image and the 
reference images, each of the reference images having an 
associated symbolic identifier; and 
associate a symbolic identifier to the input image based on the 

symbolic identifier associated with the matching reference 
image; 

a search engine executed by the computer server and adapted to receive a query 

and to retrieve a set of search results associated with the query; and 
a query processing system executed by the computer server and adapted to: 
receive the symbolic identifier of the input image from the image 

recognition system; 
provide the symbolic identifier to the search engine as a query, and to 
receive a set of search results associated with the symbolic 
identifier; and 

transmit, via the network, a plurality of the search results to the user 
device. 

12. (New) The system of claim 11, wherein the user device comprises a mobile 
telephone having an integrated camera. 

13. (New) The system of claim 1 1, wherein: 

the server receives a geographic location of the user device in association with the 
input image; and 
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the image recognition system is further adapted to match the input image to a 
reference image from the plurality of reference images based on the 
geographic location of the user device. 

14. (New) The system of claim 11, wherein the image recognition system further 
includes a character recognition system. 

15. (New) The system of claim 11, wherein the image recognition system further 
includes a facial recognition system. 

16. (New) The system of claim 1 1 , wherein the image recognition system is further 
adapted to: 

receive a plurality of images from the user device; 
store the received images as reference images; and 

match an input image subsequently received from the user device to at least one 
of the reference images received from the user device. 

17. (New) A computer implemented method for image-based searching, comprising: 
receiving at a computer server, an input image from a user device remotely 

located from the server; 
providing from the computer server the input image to an image recognition 
system; 

receiving at the computer server from the image recognition system a symbolic 
identifier associated with the input image; 
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providing from the computer server the symbolic identifier to a search engine as a 
query; 

receiving at the computer server from the search engine a set of search results 

associated with the symbolic identifier; and 
transmitting from the computer server a plurality of the search results to the user 

device. 

18. (New) A computer implemented method for image-based searching at a 
computer server, the method comprising: 

receiving an input image from a user device remotely located from the server; 

determining a plurality of graphical attributes represented in the input image; 

matching the input image to a reference image from a plurality of reference 
images stored in a storage medium, based on the plurality of graphical 
attributes of the input image and the reference images, each of the 
reference images having an associated symbolic identifier; and 

associating a symbolic identifier to the input image based on the symbolic 
identifier associated with the matching reference image; 

processing the symbolic identifier as search query to retrieve, from a search 

engine, a set of search results associated with the symbolic identifier; and 

transmitting a plurality of the search results to the user device. 

19. (New) The method of claim 18, wherein the user device comprises a mobile 
telephone having an integrated camera. 
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20. (New) The method of claim 18, wherein the image recognition system is further 
adapted to: 

receive a plurality of reference images from the user device; 
store the received images as reference images; and 

match an input image subsequently received from the user device to at least one 
of the reference images received from the user device. 

21. (New) The method of claim 18, further comprising receiving a geographic 
location of the user device through the network. 

22. (New) The method of claim 21, wherein the image recognition system is further 
adapted to match the input image to a reference image from the plurality of reference images 
based on the geographic location of the user device. 

23. (New) The method of claim 18, wherein the image recognition system further 
includes a character recognition system. 

24. (New) The method of claim 18, wherein the image recognition system further 
includes a facial recognition system. 

25. (New) The method of claim 18, wherein the image recognition system is further 
adapted to enable transmission of reference images, for use by the image recognition system, 
to the storage medium. 
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26. (New) The method of claim 18, wherein selecting a matching reference image 
from a plurality of reference images stored in a storage medium comprises: 

determining the graphical attributes in the input image represented by a plurality 

of trained attribute detectors; 
aggregating a plurality of confidence values received from the plurality of trained 

attribute detectors; and 
determining the matching reference image where the aggregated plurality of 

confidence values exceed a predetermined threshold value. 

27. (New) The method of claim 18, wherein the search results comprise links to 
websites, contact information, product information, translations of recognized characters, and 
other information related to the input image. 

28. (New) A computer implemented method for image-based searching of product 
information, comprising: 

receiving an input image from a user device remotely located from the computer 
server; 

processing the input image of the manufactured product on an image recognition 
system to obtain a symbolic identifier identifying the manufactured 
product in the input image, the symbolic identifier comprising at least one 
of a product name or a product identification number, or a product code; 

providing the symbolic identifier associated with the input image to the search 
engine as a query; 
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receiving a set of search results associated with the symbolic identifier, the search 
results including at least one document descriptive of the manufactured 
product in the input image; and 

transmitting via the network, a plurality of the search results to the user device. 

29. (New) A computer implemented method for image-based identification of 
buildings, comprising: 

receiving an input image of a building from a user device remotely located from 

the computer server; 
processing the input image of the building on an image recognition system 

executed by the computer server to obtain a symbolic identifier identifying 

the building in the input image, the symbolic identifier comprising at least 

one of a building name or a building location; 
providing the symbolic identifier associated with the input image to the search 

engine as a query; 

receiving a set of search results associated with the symbolic identifier, the search 
results including at least one document descriptive of the building in the 
input image; and 

transmitting via the network, a plurality of the search results to the user device. 

30. (New) A computer implemented method for image-based language translation, 
comprising: 

receiving an input image from a user device remotely located from the computer 
server; 
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processing the input image on a character recognition system, executed by the 
computer server to obtain text data indicative of the text in the input 
image, the text data in a first language; and 

providing the text data and an indication of a user-specified second language to a 
translation system; 

receiving from the translation system a translation of the text data into a second 
language; and 

transmitting, via the network, the translation to the user device. 

31. (New) A computer implemented method for image-based searching of human 
faces, comprising: 

receiving an input image of a human face on a computer server communicatively 
coupled with a network from a user device communicatively coupled with 
the network; and 

processing the input image of the human face on a facial recognition system to 

obtain a symbolic identifier identifying the human face in the input image, 
the symbolic identifier comprising a name of the person having the human 
face in the input image; 

providing the symbolic identifier associated with the input image to the search 
engine as a query; 

receiving a set of search results associated with the symbolic identifier, the search 
results including at least one document descriptive of the person in the 
input image; and 

transmitting via the network, a plurality of the search results to the user device. 
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